The Stability of the Replica Symmetric State in Finite Dimensional Spin Glasses 
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According to the droplet picture of spin glasses, the low-temperature phase of spin glasses should 
be replica symmetric. However, analysis of the stability of this state suggested that it was unstable 
and this instability lends support to the Parisi replica symmetry breaking picture of spin glasses. 
The finite-size scaling functions in the critical region of spin glasses below T c in dimensions greater 
than 6 can be determined and for them the replica symmetric solution is unstable order by order 
in perturbation theory. Nevertheless the exact solution can be shown to be replica-symmetric. It 
is suggested that a similar mechanism might apply in the low-temperature phase of spin glasses in 
less than six dimensions, but that a replica symmetry broken state might exist in more than six 
dimensions. 



PACS numbers: 75.10.Nr, 75.50.Lk 

An important development in statistical physics was 
Parisi's replica symmetry breaking (RSB) solution of the 
Sherrington-Kirkpatrick (SK) model of spin glasses 0. 
The SK model is the model for which mean-field theory 
is exact, by virtue of the infinite range of the interactions 
between the spins. The Parisi solution is characterised by 
a large number of pure states, organised into an ultramet- 
ric hierarchy . While there is no debate as to whether 
the RSB solution is correct for the SK model, almost 
from the beginning there has been a controversy as to 
whether it extends to real finite dimensional spin glasses. 
To extend it to finite dimensions one constructs the loop 
(perturbative) expansion around the mean-field solution. 
At least in high dimensions this perturbative expansion 
is well-defined i.e. all the integrals are finite. This pro- 
gramme is entirely conventional and most of our under- 
standing of phase transitions and the low-temperature 
phase across condensed matter physics has followed this 
route (mean-field theory, then the fluctuations around 
the mean- field). How then could it fail for spin glasses? 
This is the question which we will attempt to answer in 
this paper. 

The chief rival to the Parisi replica symmetry break- 
ing (RSB) picture is the droplet picture 0- On this 
picture there are just two pure states (the analogue of 
the up and down states of the ferromagnet), and so the 
low-tempcrature phase is replica symmetric. The prop- 
erties of the spin glass phase are governed by its exci- 
tations; the free-energy cost of flipping the spins in a 
region of linear extent L is supposed to be L e , where the 
exponent 8 ~ 0.2 in three dimensions, according to nu- 
merical studies. The droplet has fractal area L ds where 
d — 1 < d s < d and d is the dimensionality of the sys- 
tem. The droplet has a fractal surface as it wanders to 
pass the domain wall separating reversed spins through 
as many weak bonds as possible, in order to minimize its 
overall energy. Thus the droplet picture focusses on the 
low-cost excitations, which arc determined by unusual 
correlations of the bonds, and attributes the properties 



of the low-temperature phase to these 'Griffiths' singu- 
larities. 

The droplets are very intimately connected to non- 
average values of the bonds between the spins on nearby 
sites. However, in the replica trick the first step is to av- 
erage out the bond disorder. Thus after using the replica 
trick, features which can be associated with droplet be- 
havior can only arise from a treatment which goes be- 
yond straightforward perturbation theory. In the exam- 
ple which we shall discuss in detail below, at each finite 
order in the expansion about the replica symmetric so- 
lution there are instabilities which might lead one to be- 
lieve that replica symmetry must be broken. However, 
the exact solution remains replica symmetric. It is natu- 
ral to wonder whether a similar mechanism might apply 
more generally and we shall give arguments as to why 
this might happen. 

The replica field theory of spin glasses, (see Ref. 
for a review), starts from the Hamiltonian density 
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The field components q a /3 (a / (5 and q a p = qp a ) take 
all real values, and the indices such as a take the values 
1, 2, 3, . . . , n. In the limit when n goes to zero, it is hoped 
that such a field theory captures the physics of finite 
dimensional spin glasses. The quartic terms are for d < 
6 irrelevant variables [jj, as they are in the finite-size 
critical regime in any dimension so they will be dropped. 
The coefficient of the quadratic term r changes sign at 
the mean-field transition temperature T c q so r ~ (T — 

T q)/T c q. 

We will start by briefly reviewing the kind of calcula- 
tion which has led to the view that the replica symmetric 
solution is unstable 0- One begins with the mean- field 
solution which is a stationary point of the Hamiltonian 
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density of Eq. QJ . The standard replica symmetric so- 
lution (on dropping the quartic terms) is the spatially 
uniform q a p{x) = Q independent of a and /3, where 
Q = t/(ti — 2)w. Only the trivial solution Q = ex- 
ists on the high-temperature side of the transition where 
t > 0. The stability of this replica symmetric solution for 
negative r at and beyond mean-field theory will occupy 
most of this paper. 

The first step is to write 



Clafi = Q + Ra/3 



(2) 



and substitute into Eq. (without the quartic terms). 
Then up to constants 
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The quadratic terms are not diagonal. It is useful to 
first introduce the following propagators in terms of the 
Fourier components i? a ^(q) 



Gi(q) = (iMq)JM-q)>, 

G 2 {q) = (R a p(q)R a7 (-q)), /3 ^ 7 

G 3 (g) = (R a p (q)Ay5(-q)), a, P ^ i, $■ 
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Then, following Ref. the quadratic form is readily 

diagonalized in terms of three linear combinations of G\ , 
G 2 and G3: 

G B = G 1 + 2(n - 2)G 2 + i(n - 2)(n - 3)G 3 = (g 2 + |r|) 

G A = Gi + (n - 4)G 2 - (n - 3)G 3 = (g 2 + 2wQ)~ 1 
G R = G 1 -2G 2 + G 3 = {q 2 +UWQ)- 1 . (5) 

All three of these propagators are of the form (q 2 +m 2 ) -1 , 
with the mass of the longitudinal mode given by m 2 = 
|r|, of the 'anomalous' mode by m 2 A = 2wQ and of the 
replicon mode by m 2 R = nwQ. In the limit of n — > the 
breather and the anomalous masses become equal while 
the replicon mass goes to zero. Stabilty of course requires 
that all the m 2 be non-negative. Thus at Gaussian order 
the replica symmetric solution has marginal stability. (If 
we had retained the quartic terms in the Hamiltonian 
density the replicon mode would have become unstable 
at Gaussian order) . To see the apparent instability of the 
replica symmetric state it is necessary to go to one loop 
order and calculate the self-energies of the propagators. 
The replicon self-energy Hn(q) is defined via 
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(q 2 + nwQ - Sji(g))" 



(6) 



To one-loop order the calculation of T,f>(q) is straight- 
forward 6] 
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where for the wavevector sums we have introduced the 
notation 



N ^ o 2 + m 2 q 2 + m 2 , 

q " b 



(8) 



and s and s' correspond to one of the subspaces R, L. 
In the limit n — > 0, S^(0) can be approximated as 
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(q 2 +nwQ) 2 {q 2 + |r|) 2 
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In the large N limit the sum over the wavevectors q in 
Eq. © can be converted to an integral. For d > 8 the 
integrals will exist if cutoff at q = A, where A ~ 1/a and 
a is the lattice spacing. Then £r(0) ~ |t| 2 on setting n 
to zero. For 4 < d < 8, in the same limit, St?(0) does not 
require an upper cutoff and Efl(0) - |r|( d - 4 )/ 2 . When 
d < 4, the integral is dominated by its small q behavior 
and is only finite if the replicon mass is kept finite (i.e. 
by not setting n to zero): 



Sfl(0) 
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|nwQ|( 4 - d )/ 2 ' 



(10) 



For all dimensions to this order E^(0) is positive, im- 
plying that m 2 R is negative and that at one-loop order 
the replica symmetric state is unstable. However, in an 
1 earlier paper we argued that such a conclusion was pre- 
mature jsj]. One expects that deep within the ordered 
phase, that is, when |r| — > 00, loop corrections should 
be small. However, as noted above, below four dimen- 
sions Sfl(0) actually becomes infinite as n goes to zero. 
Worse divergencies exist in higher- loop corrections, as di- 
agrams exist which diverge whenever d < 6 and n goes to 
zero. We suggested therefore that it might be incorrect 
to conclude that replica symmetry had to be broken for 
dimensions d < 6, since the higher the loop correction, 
the more divergent the diagram and that one had to go 
beyond order-by-order perturbation theory in dimension 
d < 6 in order to discover whether the replica symmetric 
state was really unstable ||- 

Additional arguments were also given in Ref. as to 
why six might be a special dimension for the nature of the 
low-temperature spin glass state. If it is indeed replica 
symmetric below six dimensions then there should be no 
Almeida-Thouless (AT) line as the AT line marks the 
onset of replica symmetry breaking. This is consistent 
with the renormalization group calculation of Bray and 
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Roberts [l0| who were unable to locate a stable fixed 
point in 6 — e dimensions and as a consequence specu- 
lated that this could be due to the fact that there was 
no AT line in these dimensions. ( Simulations of three 
dimensional spin glasses seem consistent with this con- 
clusion as do experiments (l^l. 



For dimensions d > 6 the loop expansion about the 
RSB mean-field state is well-behaved [4| and one might 
therefore hope that the Parisi RSB picture for these di- 
mensions is a valid description of the spin glass state. Be- 
low six dimensions, the loop expansion has divergences 
which were related to the divergences associated with 
non-mean-field critical exponents Q. The loop expan- 
sion is meant to be used well away from the critical re- 
gion, so it is hard to understand this identification. It is 
possible that they indicate instead that the RSB state is 
unstable in less than six dimensions. 



Our old argument, that calculations to finite order in 
the loop expansion might not predict the correct stabil- 
ity of the replica symmetric state when coefficients in the 
loop expansion become infinite as n goes to zero |8j , met 
with little interest, perhaps because no concrete realiza- 
tion could be given. I can now supply an example where, 
order by order in the loop expansion, the coefficients di- 
verge as n goes to zero, have signs which indicate that 
the replica symmetric state is apparently unstable, but 
which can be exactly resummed to a solution which shows 
that the replica symmetric state is stable, which paral- 
lels what is being argued might happen in spin glasses 
for d < 6. 



This illustrative calculation is of the low-temperature 
form of the finite size critical scaling functions for d > 6, 
which can be done 'exactly'. It is as follows. One sup- 
poses that the spin glass system is of finite linear extent 
L and that the system has periodic boundary conditions. 
N = L d . Because of the periodicity of the system, the 
order parameter will be still uniform. One can proceed to 
construct a loop expansion as for the infinite system, and 
in expressions like Eq. (JJJ) the sum over wavevector com- 
ponents such as q x runs over values 0, ±2ir/ L, ±4-7r/L, . . .. 
The Fourier components of q a p (q) at non-zero values of 
q are in this context 'massive' modes and can be traced 
out perturbatively. Only the q = component has to 
be treated non-perturbatively. Above the upper critical 
dimension the arguments of Brezin and Zinn- Justin [l3| 
show that the effect of integrating out the non-zero q 
modes is simply to shift the mean-field transition tem- 
perature to the true transition and to renormalize the 
value of the coupling constant w. The properties of the 
q — fields, like those in Binder ratio plots studied in 
simulations, can then all be extracted from the partition 



function without the gradient terms 



Z = 
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A typical ratio would be 
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where the thermal averaging denoted by the angular 
brackets is done using the partition function of Eq. 
(|ll|l . By rescaling the q a/ 3 fields it is easy to see that 
= g(N t 3 / w 2 ) . The scaling functions like g(x) are the 
quantities of interest and can be calculated from suitable 
derivatives of the partition function Z. The neglect of 
higher terms such as the quartic terms of Eq. is eas- 
ily justified in the finite size critical scaling region where 
N — > oo, t — > 0, but with Nt 3 /w 2 finite. 

The partition function Z has recently been extensi vely 
studied in Ref. 01- For earlier studies see Ref. |l5j . 
On the high-temperature side of the transition i.e. when 
t > 0, we showed that the series expansion in the vari- 
able w 2 /Nt 3 , while formally a divergent series, looks as 
though it could be resummed to give useful results. The 
technique adopted to study the high-order terms in the 
perturbation expansion was to map the problem onto the 
spherical Ising spin glass in the Sherrington-Kirkpatrick 
(SK) limit [ifjj], Our concern in this paper is what hap- 
pens on the low-temperature side when r < 0. 

Let us examine the first term in Eq. (JJJ for finite N. 
In sums over q, the q = terms coming from the replicon 
propagators are infinite unless we keep n finite since the 
replicon propagator at q = is just 1/nwQ. Thus the 
most divergent part in Eq. J2J is of order w 2 /N(nwQ) 2 
and arises from the term Irr. On the other hand, the 
sums over non-zero q values can be approximated by the 
expressions previously given for E/j(0). Both types of 
terms make T,r(0) positive and apparently indicate that 
expanding about the replica symmetric state would lead 
to the usual instabilities. However, the apparent diver- 
gence of terms like w 2 / N (nwQ) 2 as n — > has first to be 
resolved. 

Such divergences occur in all orders of the expansion 
and the most divergent terms come when all the propaga- 
tors are of replicon type. At Kth order the general form 
of these contributions from q = in the replicon sector 
is {w 2 / N [nwQ) 2 ) K and retaining these terms alone gives 
terms of the schematic form 



G R (0) 1 ~ nwQ - — — — ^ + — -— r + ... 

= nwQf{w 2 /N(nwQ) 3 ). (13) 
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Thus if the function f(x) has the large x form, is, 
Gr(0) ~ Ns /w3 and the problematic n dependence 
would disappear. The argument below shows that this is 
indeed what happens. It arises from the mapping to the 
spherical spin glass in the SK limit 0. Gfl(O) physically 
is equal to 



G R (0) 



(14) 



Gr(0) can be studied directly in the spherical spin glass 
in the low-temperature regi me. It can be approximated 
using the procedures in [lj| by 



G R (0) 



> 1 

A 2 ' 



(15) 



where the eigenvalues A are related to those of a random 
symmetric Jy matrix, such that in the large N limit 



P(A) = ^[A(4-A)]*, 



(16) 



and the prime in the sum indicates that the smallest (or 
negative eigenvalues) are to be omitted from the sum 
in the finite N case. Using the infinite N form for the 
density of states the integral for Gr(0) would appear to 
be divergent from the behavior of the integrand at small 
A. However, the integral can be cutoff at the smallest 
eigenvalue, which is of order 1/iV 2 / 3 , when one can see 
that Gr(Q) is indeed of order TV 1 / 3 . In principle by doing 
numerical work on the finite N spherical model, it would 
be possible to calculate Gr(0) in the finite size scaling 
limit to any desired accuracy. 

Returning now to the loop calculation, the problematic 
terms which became infinite as n goes to zero have been 
resummed so that now 



G R (oy 



r /N~ 



(17) 



The second term of order r 2 comes from the non-zero 
q contributions in the one-loop calculation ( the quartic 
terms in Eq. also give terms of order r 2 )). Notice that 
in the finite size scaling region N — > oo, r — > 0, but with 
Nt 3 fixed, the term of order r 2 is of order 1/N 2 / 3 and 
so is negligible in comparison to the first term at large 
N. The fact that it is negligible is what would have been 
expected anyway from the arguments of Ref. fl3j |. who 
showed that the only role of the non-zero q contributions 
was to renormalise the mean-field transition temperature 
and coupling constant w. Notice that the two terms on 
the right-hand side of Eq. ((T7|l become comparable when 
Nt 6 is 0(1). In the SK limit, the number of metastable 
(TAP) states N s goes like lniV s ~ Nt 6 for small r jl^ so 
that Gfl(O) -1 only goes negative indicating an instability 
towards replica symmetry breaking when a multiplicity of 
states exist - a result entirely in accord with the natural 
expectation. 



Thus by going beyond perturbation theory we have 
tamed divergences in such a way that a calculation which 
seemingly required replica symmetry to be broken to cure 
an instability present at one loop order, is no longer un- 
stable when the divergences are summed. The diver- 
gences in the finite size calculation, when resummed, give 
in the large N limit a negligible contribution if one is not 
working in the finite size scaling limit. However, it is my 
belief that the divergences which plague the loop expan- 
sion in the low-temperature state for dimensions d < 6 as 
n goes to zero require a similar non-perturbative treat- 
ment, and if this could be done, the replica symmetric 
state would emerge as stable. 

Very recently numerical evidence [lsj has emerged that 
is consistent with our proposal that replica symmetry 
breaking occurs only when d > 6. The one-dimensional 
long-range Ising spin glass model with interactions whose 
magnitude decrease as 1/rfj was studied. When 1/2 < 
a < 2/3, the system is expected to behave like the short- 
range spin glass model with d > 6 and an AT line was 
found in this interval. No AT line was found when 2/3 < 
a < 1, the interval which is expected to mirror the short- 
range spin glass below six dimensions. These results are 
also consistent with earlier analytical calculations [lsj . 

Over many years Newman and Stein have proved a 
number of rigorous theorems concerning the nature of 
the ordered phase in finite dimenensional spin glasses 
[jof. For d < 6 our proposal that the ordered phase is 
replica symmetric and droplet-like is completely consis- 
tent with their theorems. For d > 6 their 'chaotic pairs' 
picture fits with our proposal (but there are also other 
possibilities). In the chaotic pair picture the domain wall 
exponent 9 > but its fractal dimension d s = d. In other 
words the domain walls are space-filling. Also their the- 
orems do not rule out an AT line when d s = d. The 
global Parisi overlap function P(q), which is closely re- 
lated to the spatially uniform order-parameter q a p , could 
be non-trivial for the chaotic pair state, possibly even 
RSB-like. They emphasize in their work though that the 
global P(q) is not useful for understanding the properties 
of pure states in finite dimensional glasses. 

I should like to acknowledge the hospitality of the As- 
pen Center of Physics, Colorado, USA during the writing 
of this paper. I am also very grateful to Dan Stein for 
patiently explaining his results with Newman to me. 
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